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ABSTRACT 


AN  ANNOTATED  BIBLIOGRAPHY  OF  SELECTED 
REFERENCES  ON  MAXIMAL  INEQUALITIES  AND 
THEIR  APPLICATIONS 


This  report  provides  an  annotated  bibliography  of  selected  papers,  new 
and  old,  which  we  regard  as  useful  to  current  inquiry  into  maximal  inequalities 
and  their  applications.  By  "maximal  inequalities"  we  mean  inequalities  placing 
upper  bounds  on  either  the  moments  or  the  exceedance  probabilities  relative 
to  the  maximun  consecutive  sum  , 1 < k s n,  over  a sequence  of  random 

variables  The  bibliography  of  papers  is  prefaced  by  a brief 

introduction  to  maximal  inequalities  and  their  applications.  Various  classical 
results  are  cited. 


0.  Summary.  Section  1 provides  a brief  Introduction  to  maximal  Inequal- 
ities and  their'  appllca!tlons.'  Various  classical  results  are  cited.  Section  2 
provides  an  annotated  bibliography  of  selected  papers j new  and  old,  which  we 
regard  as  useful  to  current  Inquiry  Into  this  area  of  probability  theory. 
Finally,  the  list  of  references  at  the  end  Includes  not  only  the  works  cited 
in  Sections  1 and  2 but  other  key  sources  as  well.  Here  each  item  is  classi- 
fied according  to  emphasis  on  theory,  or  applications,  or  both. 

1?  Introduction.  Let  X2*‘‘  be  a sequence  of  random  variables  defined 
on  a probability  space  (fi.  A,  P)  and  pur  = I"  n = 1,  2,  •••  . 

Among  the  tools  most  useful  to  probability  theory  are  the  many  Inequalities 
which  place  bounds  on  the  moments 

E{  max  |\|''.}  , 
l^<n 

or  on  the  exceedance  probabilities 

for  suitable  choices  of  v Such  Inequalities  are  called  maxvrtat  Inequal- 

ities. A classical  example  is  the  following  (Tucker  (1971)). 

KOUIOGOROV'S  INEQUALITY.  Let  Xj^,’*',  X^  be  mutually  independent  with 

means  0 and  variances  o,^,***,  a Then 

1 n 

•~2,  ^ 2 

P{li5g5nl'^i-l  ^ h}  < , every  X > 0. 


Iff  in  addition^  there  exists  K<  ® for  which  P{|x^l  s k)  - 1,  1 ^ 1 ^ n,  then 

2 


P{^mgx  ISj^l  ^ X}  i 1 - 


5 ^ , every  X>0. 

II 
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These  two  Inequalities  are  extremely  useful  In  proving  strong  laws  of  large 
numbers  for  independent  variables.  They  are  also  applied  In  proving  conver- 
gence and  stability  properties  for  consecutive  sums  of  Independent  random 
variables  (Lbeve  (1963)).  The  following  theorem  developed  by  Kolmogorov  is 
such  a result. 

THREE  SERIES  CRITERION.  Let  Xj^,  Xj,***  he  independent.  The  aeriee  ^ 
converges  almost  surely  if  and  only  if  for  some  constant  C > 0 the  following 
three  series  converge-. 

(i)  I"P{1X^12C} 

(ii)  I"  E{X^  I(|X^|  < C)} 

(ill)  r Var{X  I(|X  I < C)}  . 

1 n n 

The  Hajek-Renyi  inequality  contains  the  Kolmogorov  inequality  as  a 
special  case.  It  was  found  by  Hikjek  in  1953  and  Renyi  later  provided  the 
standard  proof  of  this  result  (Hijek  and  Rdnyl  (1955)). 

HAJEK-RENYI  INEQUALITY.  Let  {X^}  be  mutually  independent  with  means 

2 

0 and  finite  variances  . Let  (c^}  be  a nonincreasing  sequence  of  positive 
numbers.  Then,  for  X > 0 and  for  positive  integers  b s n, 

n n 

H niax  c IX.  + •••  + X 1 2 X}  S X"^(c^  I oj  + [ cjaj)  . 
msis  n ^ ^ ^ ” i-1  ^ iinri-1  ^ ^ 

The  use  of  this  inequality  in  place  of  Kolmogorov's  inequality  makes  it  possible 
to  simplify  the  proofs  of  strong  laws  of  large  numbers  and  related  theorems 
(see  Gnedenko  (1968)). 

Another  widely  used  inequality  of  the  theory  of  suns  of  Independent 
random  variables  is  the  L6vy  Inequality.  It  is  of  somewhat  different  nature 
than  the  Kolmogorov  or  H^jek-R£jnvl  inequalities.  By  centering  suns  of 
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Independent  random  variables  at  suitable  medians,  L4vy  (L6eve  (1963))  obtains 
an  Inequality  which  can  play  the  role  of  Kolmogorov’s  inequality.  Let  u(X) 
denote  a median  for  the  random  variable  X. 

LEVY  INEQUALITY.  Let  {X^}  be  mutually  independent.  Then,  for  every 

X > 0, 

P{  -ax  CS,  - u(S,  - S )]  > X}  < 2 P{S^  a X} 

. 1 1 n n 

l<l<n 

and 

P{  nax  |S  - ii(S^  - S^)|  > X}  < 2 P{|S^|  S X)  . 
li^iSn 

Random  variables  which  are  not  necessarily  independent  will  now  be 
considered.  In  the  case  of  orthogonal  random  variables,  a classical  theorem 
is  the  Rademacher  - Mensov  Inequality. 

RADEMACUER-MENSOV  INEQUALITY.  Aaeume  without  loss  of  generality  that 

the  random  variables  X, ,••*,  X have  means  0.  Let  X, X^  he  mutually 

In  in 

2 2 

orthogonal  {i.e.,  ECX^Xj)  * 0,  i * j)  and  have  vaxnanaes  • 

Then 

E{  -ax  |S,  1^}  i (log,  4n/^  [ . 

l<l<n  ^ i-1  ^ 

Playing  a role  similar  to  Kolmogorov's  inequality  in  the  independent  case,  this 
Inequality  is  applied  in  the  proofs  of  almost  sure  convergence  and  stability 
theorems  well-known  in  the  theory  of  orthogonal  functions  (see  Lodve  1963)). 

Both  Kolmogorov's  and  Levy's  Inequalities  can  be  generalized  by  examination 
of  their  proofs  and  noting  that  the  centering  of  the  independent  random  vari- 
ables at  expectations  or  medians  was  a key.  Propositions  similar  to  those  in 
the  case  of  independence  are  obtained  by  means  of  centering  at  conditional 
expectations.  Such  centerings  provide  an  Important  dependency  model,  martingales. 
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whlch  is  a natural  generalization  of  that  of  consecutive  sums  of  independent 
random  variables  centered  at  expectations  (Lofeve  (1963)).  Doob  (1953)  con- 
siders a more  general  setting  and  establishes  the  following  inequality. 

DOOB  INEQUALITY.  Let  he  a submcoptingale . Then,  for  all 

X > 0, 

-ax  > \]  < X"^  E{T(fflax  X.  > X)X^}  S X"^  E{|X^|)  . 
l<i<n  ^ iSi<n  ^ 

Furthermore,  if  the  X^'s  are  nonnegative,  then 

* A ‘ 

E{  nax  X^}  i ■ 

ISjSn  ^ 

(:^)'’  /or  V > 1. 

This  theorem  contains  Kolmogorov's  inequality  which  provided  the  main  tools 
for  the  proofs  of  strong  laws  of  large  numbers.  An  examination  of  these 
proofs  reveals  that  the  assumed  independence  of  these  variables  was  used  only 
to  derive  certain  inequalities  among  expectations.  Hence,  by  the  above  theorem, 
the  main  results  in  the  Independence  case  carry  over  to  martingales  and  sub- 
martingales. Such  generalizations  are  Important  for  many  applications  and 
they  throw  new  light  on  the  nature  of  the  strong  laws  of  large  numbers.  The 
limit  properties  of  submartingales  are  summarized  in  the  Submartingale  Con- 
vergence Theorem  found  in  Lo&ve  (1963).  The  proof  of  this  result  is  based  on 
Doob's  Inequality. 

A powerful  technique  for  proving  the  weak  convergence  of  a random 
sequence  in  C[0,I]  is  to  first  prove  that  the  finite  dimensional  distributions 
of  the  sequence  converge  weakly  and  then  to  show  that  the  sequence  is  relatively 
compact.  In  order  to  use  this  method,  an  effective  criterion  for  relative 
compactness  is  needed.  Prohorov's  theorem  states  that  in  an  arbitrary  metric 

.j 
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space  a sequence  of  measures  is  relatively  compact  If  It  ii  'light.  Thus  the 
necessary  criterion  now  is  to  show  tightness  of  a sequence.  Billingsley  (1968) 
establishes  tightness  for  sequences  of  random  elements  of  C[0,1]  by  finding 
bounds  for  the  distribution  of  the  maximum  of  certain  part'll  sums.  The 
following  maximal  inequality,  proved  by  Billingsley  (1968,  p.  94),  leads  to 
a practical  tightness  criterion. 

Let  Xj^,***,  be  arbitrary  random  variables.  Suppose  that  for  constants 
V s 0 and  Y > 1 and  nonnegativm  constants  uj^. " ' » Uj^i 

P(|  1 X.  I i X)  s X"''  ( J u )^  iall  ^ s i < ) n,  . X > 0). 

k-i  k-1 

Then  m n 

P(  cif-r  1 [ X^l  i X)  6 C ( I u {all  \ ■ < ), 

l<^<r  k»l  ''  k-1 


where  C 

v.Y 


depends  only  on  v and  y. 


A HAjek-Rcnyl  type  inequality  for  U-statlstlcs  obtainad  by  Sen  (1970) 

is  used  to  show  the  weak  convergence  of  a sequence  of  random  variables 

(Y^,(t)}  to  a Brownian  bridge.  It  is  applied  in  the  following  manner.  First 

a related  sequence  {Y®(t)}  is  shown  to  converge  in  dlsti ibution,  as  N'+«>, 

N 

to  a Brownian  bridge.  TJio  naxinnl  inequality  is  then  used  to  show 

®'iplYjj(t)  - Y*(t)|  converges  in  law  to  0 as  N-*®.  Hence  the  c mvergence  of 

is  shown.  Other  forms  of  the  HAjek-Rdnyi  inequalit,  for  u-statistics 
arc  obtained  in  Serf ling  (1974). 

Other  uses  of  maximal  lnequaliti<.s  pertain  to  roce^;  f convergence 
ill  strong  laws  of  large  numbers  and  to  laws  of  the  iterated  logarithm  (see 
Serf ling,  1970b).  Dudley  (1972)  adapts  a maximal  inequality  ■ f Skorohod  to 
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obtain  speeds  of  metric  probability  convergence.  Simultaneous  confidence 
regions  for  stochastic  vectors  are  obtained  by  Sen  (1971)  by  using  a H&jek- 
R^nyi  - type  inequality.  There  are  many  other  applications  jf  maximal  in- 
equalities but  the  above  discussion  more  than  substan'Ciates  their  Importance. 
2.  Annotated  Bibliography. 

AttEXITS,  G.  (I'^Tl).  On  the  convergence  of  function  series.  Acta.  Soi.  ^kith. 
Szeged  3^  1-9 . 

The  author  proves  an  inequality  which  plays  a role  similar  to  the  role 
played  by  the  Rademacher-Mensov  inequality  in  the  theory  of  orthogonal  series. 

Let  Q,  be  a measurable  space  with  a positive  measure  u and  a 

sequence  of  measurable  functions  in  fi.  On  the  measurable  set  B eft, 
consider  the  Lebesgue  functions  of  the  system  {f^(x)}, 

= /I  I * 

L k»0 

and  for  an  index  sequence  ^ 

(E)  = / max  (x.)  dp(x)  . 

n E 0Sj<n  J 

Let  m s n be  fixed  positive  integers  and  denote  by  m(x)  and  n(x)  measurable 
functions  taking  only  integer  values  between  m and  n.  Then 

(x)|du(x)  < (16L  (E)  I 

E '^n(x)  ''m(x)  ''n  k*v  ^ 

o 

where  (a^j)  is  a sequence  of  real  numbers  and 

V 

n k»0 

The  above  inequality  becomes  a maximal  inequality  by  choosing  for  m(x) 
the  least  integer  greater  than  or  equal  to  m and  for  n(x)  the  largest  integer 


1^  i 


less  than  or  equal  to  n such  that 


|Sy  - I = max  (x)  - P (x)  I . 

n(x)  m(x)  m<isi<n  1 1 

This  inequality  is  then  used  to  prove  the  result : 

^00  2 

If  (E)  SK  (n=  1,  2,***)  then  {S^  (x) } converges  almost 

n n 

surely  on  E.  D 

BICKEL.  P.  J.  (1970).  A HAjek-Renyi  extension  of  Levy's  inequality  and  some 
applications.  Acta  Math.  Acad.  Set.  Hung.  ^ 199-206. 

Bickel's  extension  of  Levy's  inequality  is  two-fold.  He  deals  with 
symmetric,  Independent  random  variables  {X^}  and  introduces  a decreasing 
sequence  of  nonnegative  constants  (c^}  into  the  inequality,  as  in  the  HAjek- 
Rdnyi  inequality. 

Let  {X^}  be  an  independent  sequence  of  random  variables  symmetrically 

distributed  about  zero  and  let  tc^^}  be  a decreasing  sequence  of  constants. 

Let  g be  a nonnegative  convex  function  on  the  reals. 

Define  ^ 

^n  “ J,  ^‘^i  - ‘=i-l>  + c^  g(S^)  . 

i"l 

.1  ~rtve  = I":X^.  Then,  for  all  e 0, 

P{  max  c,  g(S.  ) > e)  S 2 P{G^  it). 
l‘:i'<r. 

This  inequality  is  used  to  obtain  conditions  under  which  E{  sup  c |s  1°*}  < 

P>1  " 

where  a ^ 1.  This  result  is  useful  in  optimal  stopping  problems  involving 

payoffs  of  the  form  c IS  I**  . p 

n'  n' 


BIRNBAUM,  2.  W.  and  MARSHALL,  A.  W.  (1961).  Some  multivariate  Chebyshev 


inequalities  with  extensions  to  continuous  parameter  processes.  Ann.  Math. 
Statist.  32  687-703. 

A model  for  the  various  generalizations  of  Chebyshev 's  inequality  is 
discussed.  A standard  proof  of  these  inequalities  is  then  outlined.  Exam- 
ination of  this  method  of  proof  yields  some  general  techniques  concerning  the 
problems  of  deriving  inequalities  and  of  proving  sharpness.  The  authors  then 
derive  a maximal  Inequality  and  show  tjiat  equality  can  be  achieved.  Several 
known  generalizations  of  Kolmogorov's  inequality  are  obtained  by  specif ing 
the  variables  and  further  specializing  the  assumptions  in  their  maximal 
inequality.  [] 

BOROVKOV,  A.  A.  (1972) . Notes  on  Inequalities  for  sums  of  Independent 
variables.  Th.  Prob.  AppHa.  ^ 556-557. 

The  author  proves  that  Inequalities  obtained  by  Nagaev  and  Fuk  (1971)  for 
the  probability  S x},  where  the  are  sums  of  independent  random 

variables  remain  valid  also  for  the  maximum  of  the  sums  provided  one 
further  condition  is  imposed.  The  inequalities  have  the  form 

n 

P{S^  > x}  S [ P{X^^  > v^}  + P , 

k=l 

*r- 

where  P is  an  estimate  of  the  probability  ^ x},  where  is  the  sum  of 

the  truncated  variables  Xj^  = rain  (y^^,  The  author  also  deroonstCAtes 

that  the  estimate  of  P(S^  i x)  by  pseudo-moments  obtained  by  Ebralidge  (1971) 

is  preserved,  with  insignificant  changes,  for  P{  max  S,  2 x}.  D 

kin 

BURKHOLDER,  D.  L.  (1964).  Maximal  inequalities  as  necessary  conditions  for 
almost  everywhere  convergence.  Z.  Wahreaheinliahkeitetheorie  3 75-88. 


Let  (n.  U,  Vi)  be  a probability  space.  Let  D be  the  collection  of  all 
sequences  f = (f^^,  f^,  ...)  with  each  an  ^/-measurable  function  from  n into 
the  complex  numbers.  For  feD,  define  f*  by 

.1  .■  i , , . ■ , 4 ^ ' * ■ ■■  ■ . 

f'>(w)  = sup  |f  (oi)  I , ui  e n.  ' 

l<;n«»  " 

Let  C c D and  0 < p < “. 

Question:  What  conditions  on  C assure  the  existence  of  a real  number 

K satisfying 

li{f*  > A}  ^ A"Pr  , a > 0 , feC  ? 

In  particular,  under  w,  at  conditions  on  C does  the  almost  sure  couvetsencc  of 
each  sequence  in  C imply  the  existence  cf  such  a K? 

Burkholder  answers  the  question  in  the  main  theorem  of  his  article. 

The  assumptions  and  conclusions  of  the  theorem  are  complicated.  Briefly, 
the  class  of  sequences  to  which  this  theorem  may  be  applied  must  be  large, 
in  a certain  sense,  and  closed  under  certain  operations  by  which  new 
sequences  are  formed.  The  author  presents  examples  of  sets  C that  satisfy 
these  conditions.  The  theorem  is  then  applied  to  a problem  in  operator 
ergodic  theory,  f) 

J^RKHOLDER.  D.  L.  (1973).  Distribution  function  inequalities  for  martin- 
gales. Ann.  of  Prob.  19-^  2. 

This  article  is  a guide  to  some  recent  martlneale  inequalities. 

The  underlying  theory  in  these  inequalities  was  Introduced  in  Bur'  holder  and 


Gundy  ^970).  The  author's  main  objective  is  to  simplify  some  of  the  ideas 
and  methods  of  the  earlier  article  and  to  illustrate  their  use  by  a number 
of  applications,  old  and  new.  D 

BURKHOLDER,  D.  L.  and  GUNDY,  R.  F,  (1970).  Extrapolation  and  interpolation 

of  quasl-linear  operators  on  martingales.  Aata  Math.  (Uppsala)  124  249-304. 

From  the  author's  introduction,  "In  this  paper  we  introduce  a new 

method  to  obtain  one-sided  and  two-sided  integral  inequalities  for  a class 

of  quasi-linear  operators.  The  suitable  choice  of  starting  and  stopping 

times  for  martingales,  together  with  the  systematic  use  of  maximal  functions 

and  maximal  operators,  is  central  to  our  methods." 

Let  f = (fj^,  f^,...)  be  a martingale  and  d = (dj^,  d2,...)  its  difference 

sequence.  Let  f*  = sup|f  |.  f*  is  related  to  the  square  function, 

n>l  " 

s(f)  = ill 

Cp|lS(f)  11^  < |[f*||p  < Cpj(S(f)  lip 

where  c and  C are  constants  and  1 s p £ New  information  about  this 
inequality  is  obtained  in  two  directions.  For  a special  class  of  martin- 
gales, the  authors’  method  allows  them  to  extend  this  inequality  to  the 
range  0 < p ^ In  a second  direction,  the  authors  show  that  the  operator 
S:f->S(f)  may  be  replaced  by  other  operators  la  the  above  inequality.  Two 
applications  of  these  results  are  in  the  area*  of  classical  orthogonal  series  and 
of  Byrwnlaa  •motion  proce«UMt*.  'ore  general  integral  Inequalities  and  other 
applications  are  also  presented.  □ 


-11- 


CHOW,  Y.  S.  (1960).  A martingale  inequality  and  the  law  of  large  numbers. 
Proa.  Amer.  Math  Soc.  11  107-111. 

The  following  extension  of  the  HAjek-Renyi  inequality  is  presented. 

Let  {Yj^:  k > 1}  i>e  a semi^martingale ; let  ^ C2  ^ ’"be  positive 
constants  and  let  e > 0.  Then 

where  = max  (Y,  0)  . 

t 

Tnus,  if  Yj^  is  the  square  of  the  sum  of  k random  variables  with  zero 
means  and  finite  variances,  then  the  inequality  reduces  to  the  HSjek-RSnyi 
inequality.  Chow's  inequality  contains  as  a special  case  an  Inequality 
contained  in  Doob  (1953),  where  The  inequality  is  used  to  prove  a 

law  of  large  numbers  for  a martingale.  The  key  to  the  proof  is  to  apply 
the  inequality  in  the  same  manner  that  Kolmogorov's  inequality  is  applied 
in  proving  the  law  of  large  numbers  for  a sequence  of  independent  random 
variables.  □ 


CSORGO  MIKLOS  (1968) . On  the  strong  law  of  large  numbers  and  the  central 
limit  theorem  for  martingales.  Trans.  Amer.  Math.  Soc.  131  259-275. 

Generalizations  of  Kolmogorov's  inequality  for  martingales  and  for 
submartingales  are  presented.  The  generalizations  consist  in  admitting 
largely  arbitrary  factors  in  Kolmogorov's  inequality. 

Let  {Yj^}  be  a submartingale  with  ^ 0 k.  If  {Cj^}  is  a non- 

increasing  sequence  of  positive  constants,  then  for  e > 0 and  m <,  n 


U-J. 

P{  nax  cf  Y S e}  S e"^  ( I (cf 
m<kSn  k=u 


2 

'^k+l 


)i:{\)  + C 


2 

U 


L{Yn))  . 
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The  proof  of  this  inequality  is  similar  in  style  to  that  of  the  U^jek-R^nyi 
Inequality,  but  exploits  the  submartingale  property  of  the  Yj^'s  to  gain  the 
added  generality. 

Tht  author  uses  this  inequality  to  prove  a generalization  of  Kolmogorov's 
Inequality  for  martingales. 

Let  {X^}  he  a sequence  of  random  variables  with 

(1)  E{Xj}  - 0,  E{X^|x^,--»,  = 0 , n > 2 , W»p.l. 

Define  S “ I?  X.  . Jf  E{S  ® for  all  n and  {c.  } is  an  increasing 

n i i n n 

sequence  of  positive  constants,  then  for  all  m < n and  arbitrary  e > 0 
r<k^n  k“m 

■ • 

k=l  k=nri-l 

If  m = 1,  we  have  Kolmogorov’s  inequality  for  martingales.  If  the 

Xj^'s  ate  Independent,  we  have  the  Hhjek-Rfenyi  inequality.  The  proof  of  this 
inequality  follows  by  noting  th  t {S  ) bein  i mrtin  ale  l.upliv.-s  {S^}  is  a 
subcartint^ale  >n_  thtn  apply  in;;,  the  author's  inequality  f_r  submart  inpales. 

The  Second  form  of  the  beunJ  f.  llov/s  from  the  "absolute  fairness’’  of  the 
sequence  that  is,  assumption  (1).  H 

DAVIS,  BURGESS  (1970).  On  the  integrability  of  the  martingale  square 
function.  Israel  J.  Nath.  8_  187-190. 

Let  f “ (fj^,  be  a martingale  and  be  its  difference  sequon.ee, 

that  is,  f^  - J”  dj£,  n 2 1.  The  follo^'lno  re<"ult  n-oertn  t>iat  the  T,^«nor-'': 
of  sup  If  I and  of  (JTCf  - f are  equivalent. 

n>i  " 1 
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Define  f*  =■  sup  [f  | caid  S(f)  =>  Cil  Then  there  are  tuo  positive 

n>l  ^ 

numbers  a and  A such  t^vat 

ail  S(f)||  < ||f*||  ^ ^1|S(')|I. 

Thu  author  then  presents  an  extension  of  the  above  result  to  a class  of 
more  general  operators. 

Let  M and  N be  matrix  operators,  that  is,  an  operator  which  can  be 
expressed  in  the  form 

OOfl 

n(f)  » ( I (lln  s«>|  I a d . 

j = l n •>  » k-1  J 

, ^ 00  2 
where  ts  a matrix  of  real  numbers  such  that  a ^ ^ ^ 

and  A positive  numbers.  Let  U^(f)  -denote  where  f”  is  f stopped  at  time 

n,  and  let  h*(f)  = sup  There  is  a constant  a(M,  N)  such  that  if  f is 

n>l 

a martingale  then 

II  M*(f)|i  s a(H,  N)  If  N-*(f)  !|  . n 

DUDLEY,  R,  M.  (1972).  Speeds  of  metric  probability  convergence. 

2.  Wahrscheinliohkeitotheorie  22  323-328. 

From  the  author's  introduction,  "This  is  a survey  on  speeds  of  conver- 
gence in  prc'-ability  limit  theorems  for  the  Prohorov  metric  p and  the  dual- 
boundeu-Llpschltz  metric  6.  many  of  the  results  are  new  as  stated,  although 
they  follow  rather  easily  from  previously  known  theorems  and  proofs." 

ilore  specifically,  the  author  Investigates  speeds  of  convergence  in 
laws  of  large  numbers,  central  limit  theorems,  Gllvenko-Cantelli  theorems 
and  also  for  the  invariance  principle,  the  convergence  to  the  Poisson 
process  and  the  convergence  of  empirical  distribution  functltes.  An  adapta- 
tion of  a maximal  inequality  of  Skorohod  is  proved  and  used  to  obtain  "big  0" 


bounds  on  p(L(Y  ),  L(U))  and  &(L(Y  ),  L(U)),  where  Y is  the  "random  broken 
n n n 

line"  process  and  W is  the  Brownian  motion  process.  H 


FRAI>1K,  OVE  (1966).  Generalizations  of  an  inequality  of  Hiijek-Renyl.  Skand. 
Akt.  49  85-89. 


The  author  proves  the  following  theorem. 


Let  X2,’*‘  be  a sequence  of  nonnegative  random  variables  and  let 
k=l,  2,'**  , utth  e > 0.  Define  X^  = 0 , = ({i  and 

A^Ai  Then 


P{  max 
likin 


^ ^ c-‘  II  /(\  - Vl>"  • 

\ 


From  this  inequality,  the  author  derives  the  Doob  inequality  for  submartin- 
gales, the  Hcljek-Renyl  inequality  for  arbitrary  constants  and  the  Rosen 
(1964)  Inequality  for  a random  permutation  of  N real  numbars.  He  applies 
the  inequality  in  proving  an  extension  of  a theorem  of  Granander  (1965) 
on  almost  sure  convergence  of  S /L{S  } , where  S = Y,+  •**+Y  , Y = min 
(Zj^,***Z^)  and  Z^^,*'*  , Z^  are  nonnegative,  independent  and  identically 
distributed  random  variables.  H 

HEYDE,  C.  C.  (1968).  An  extension  of  the  Hijek-R6nyl  inequality  for  the 
case  without  moment  conditions.  J.  Applied  Prob.  6 481-483. 

(also  see  J.  Applied  Prob.  ^ 430,  for  correction  note). 

The  HSjek-R^nyi  inequality  is  extended  for  arbitrary  Independent  random 
variables  concerning  which  the  existence  of  expectations  and  variances 

is  not  supposed.  This  is  achieved  by  writing  Xj^  in  the  form 
where  Y^^  has  zero  mean  and  finite  variance.  Such  a decomposition  is  always 
possible,  e.  g.,  by  means  of  truncation. 
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Let  be  a noninareasing  sequence  of  positive  numbers.  Then,  for 

any  e>0,  0<n<l  and  any  positive  integers  m and  n (m  < n) 

' c^ISj^l  ^ e)  s a'-  n)"^  T[  ^{Y^}  + cj  e{y2}  + 

■ nH-1 

+ p ?>{Z  ^ 0}  + P{c  I r \\  i 2'^  ne}  , 
r+1  ra  ^ V. 


for  any  r < m. 


Obviously,  the  standard  H2ijek-Rdnyi  inequality  is  recoverable  from  this 
extended  version.  Note  also  that  in  order  to  get  a sharp  inequality, 
it  is  necessary  to  use  a decomposition  such  that  the  probabilities  * 0} 

are  small.  Tomkins  (1971)  gives  a slightly  different  version  of  the  Heyde 
extension.  H 


KOUHIAS,  EUSTRATIOS  G.  and  'JENG.  TEilG-SHAN  (1969).  An  inequality  and  almost 
sure  convergence.  Ann.  Math.  Statist.  ^ 1091-1093. 

The  authors  present  an  inequality  for  random  variables  in  < r i 1, 

which  has  the  same  fona  as  the  riSjek-Renyl  inequality. 

Xj^,  X^,”*  be  a sequence  of  random  variables  such  that 
E{|Xj^l’^}  - v^  < “ for  some  0 < r s 1 and  all  i = 1,  2,  •••  . If  Cj^, 
is  a non-inareasing  sequence  of  positive  constants,  then  for  asty  integers 
m,  n with  m < n and  arbitrary  e > 0 


’’'nSSln  ^ 1^1  ‘I 


A second  inequality  is  given  for  r S 1.  Under  the  above  assumptions, 
but  with  r s 1,  the  right  hand  side  of  the  above  Inequality  becomes 


e"’'(c 


r>  + r 


nrf-l 


1/r 


By  using  the  above  two  inequalities  in  conjunction  with  Kronecker's  lemma, 
it  is  shown  that  X^)/b^-K)  almost  surely  as  n-K»,  for  any  sequence  of 
constants  The  maximal  inequalities  are  then  used  to  show  that 

max  Xil-K)  in  probability,  as  This  result  yields  the  almost 

sure  convergence  of  I"  0 

tiARSHALL,  ALBERT  W.  (1960).  A one-sided  analogue  of  Kolmogorov's  inequality, 
Ann.  Math.  Statist.  ^ 483-487. 

It  is  shown  that  for  e > 0 and  for  a random  variable  X,  with  E{X)  = 0 
and  E{X^}  < P{X  S e>  S E{X^}/(e^  + E{X^}),  for  all  e > 0.  This  paper 
presents  an  inequality  that  generalizes  this  inequality  in  the  same  way  that 
Kolmogorov’s  inequality  generalizes  Chebyshev's  inequality.  An  example  is 
presented  to  show  that  the  inequality  is  sharp.  The  proof  of  the  maximal 
inequality  is  similar  to  the  standard  proof  of  Kolmogorov's  inequality, 
tlarshall's  Inequality  is  then  extended  to  continuous  parameter  martingales.  A 
condition  under  which  equality  can  be  achieved  is  also  given.  H 

MCEEISH,  ’O.  L.  /’1975).*  A ".aximal  inenuality  and  denendent  strong  laxi/n. 

Ann.  Proh.  2.  829-840. 

The  author  proves  an  extension  of  Doob's  martingale  inequality.  This 
inequality  is  then  used  to  extend  the  martingale  convergence  theorem  for  L2- 
bounded  variables  and  to  prove  strong  laws  under  dependent  assumptions. 

Strong  and  (^-mixing  variables  are  shown  to  satisfy  the  conditions  of  these 
theorems  and  hence  strong  laws  are  proved  as  well  for  these  variables.  H 
lilLLAR,  P.  WARWICK  (1969).  Uartingales  with  dependent  increments.  Ann.  Math. 
Statist.  ^ 1033-1041. 

Let  {A^}  be  an  increasing  family  of  sub-sigma  fields  of  A.  Let 

f ■ (f  , A i n “ 1,  2,'*')  be  a martingale  and  define  d * f - f The 

n n t f / o n n n-1 

sequence  g a ■ 1,  2,**’l  is  called  a transform  of  f under  v provided 


that  g = ) V,  d,  , where  v = {v  , n = 1,  is  a aequence  of  random 

n I h K n 

variables  with  v being  A , -measurable.  L, -bounds  are  obtained  for 
n ^ n-1  1 

where  {g.}  is  a tranrf:—r!  of  a discrete  oarameter  martlneale 

l<:V<n 

having  Independent  Increments.  An  application  of  this  result  to  the  theory 
of  stochastic  integrals  with  respect  to  a continuous  parameter  martingale 
with  Independent  increments  is  presented.  H 

lx.IROV . V . V . (1973).  On  strengthenings  of  some  laws  of  large  numbers  for 

stationary  sequences.  Vokl,  Akad,  Nauk.  213  42-44  (in  Russian). 

Petrov  formulates  the  following  result  on  growth  of  sums  of  random 

variables  without  any  supposition  on  independence  or  statlonarlty . 

Let  (X  } be  <2  eequenae  of  random  variables,  S = V”  X . , and  let  {a  } 
n -I  j n'-li  n 

be  a sequence  of  nondecreasing  numbers  with  and 

6 > 0 and  fixed  y from  the  interval  (1,  1+3),  let  there  exist  positive 
constants  e and  C such  that 

r-{  max  S s ^ r(i.or  a )"^“'^ 

. l<k<n  n 

for  all  sufficiently  large  r.  Then  liai  sup  S /a  SI  almost  surely. 

n n n 

This  result  is  then  used  to  derive  propositions  which  strengthen  some 
laws  of  large  numbers  for  stationary  sequences.  H 

PROHOROV.  YU.  V.  (1956).  Convergence  of  random  processes  and  limit  theorems 
in  probability  theory,  Th.  Prob.  Applia.  157-212. 

Kolmogorov's  inequality  and  a maximal  inequality  involving  exponential 
bounds  are  used  to  prove  necessary  and  sufficient  conditions  for  the  conver- 
gence of  distributions  of  "random  broken  lines'",  formed  by  sums  of  independent 
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random  variables,  to  the  distribution  of  the  Wiener  process.  Their  roles  in 
the  proof  are  to  show  that  a sequence  of  distributions  is  weakly  compact. 

The  inequality: 

2 

Let  be  independent  with  E{X^}  s 0,  L{X^  } < “,  all  i,  and 

* Xj^  +•  • •+  X^.  Then,  for  e > 0, 

P{  max  Is. 1 > e}  S 2P{ Is  1 > £ - /2  Var(S  )}  , 
l:£lSn  in 

is  used  to  obtain  an  estimate  of  the  rate  of  convergence  in  distribution  of 
a "random  broken  line  1"  process  to  the  Wiener  process.  PI 

RAO,  B,  L.  S.  PRAKASA  (1969).  Random  central  limit  theorems  for  martingales. 
Aata  Math.  Aaad.  Soi.  Uung.  ^ 217-222. 

The  author  proves  the  following  result. 

Let  be  a strictly  stationary  evgodic  sequence  such  that  E{Xj^}  = 0, 

E{xf>  E 1,  and  E{X  |x  X,}  = 0.  Furthermore,  assume  that  {X  } 

1 n n-i  i n 

satisfies  a modified  version  of  the  Bosenblatt  strong  mixing  condition. 

Let  any  sequence  of  positive  integer  valued  random  variables  such 

that  n ^ converges  in  probability  to  a positive  random  variable  p,  having 
a discrete  distribution.  Then 

V X 

lim  P{v^  ^ “ /(2it)  exp(-t^/2)dt. 

jy>oo  —oo 

In  the  proof  of  the  above  theorem,  a generalized  form  of  the  Kolmogorov 

inequality  is  applied  to  show  that  (S  - S,-  converges  in  probability 

V L un  J 

n 

to  0,  where  S = X,  X . fl 

n 1 n 
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REVfsZ,  P.  (1965a).  On  a problem  of  Steinhaus.  Aata  Math.  Acad.  5ci. 


Hung.  16^  311-318. 


Let  X,,  X„,‘”  be  a sequence  of  random  variables  with  sup  E{X^}  < “. 

^ ^ k>l 

The  author  establishee  the  existence  of  a random  variable  Y and  an  increasing; 

sequence  of  positive  integers  such  that  if  c^^,  C2>’'’  is  a real 

T*®®  2 / \ 

number  sequence  with  I c.  < ^ , then  the  series  K c,  (X  - Y)  converges 

1 K 1 K 

wi-th  probability  1.  In  proving  this  result,  the  author  derives  a taajtlfial 

inequality  analogous  to  Kolmogorov’s  inequality.  The  inequality  is  used  to 

T'  n 

prove  that  the  sequence  {S  } is  almost  surely  Cauchy,  where  S = ^ c.Z  , 

n o . > ic  n. 

k»l  k 

^k  * ^ ^1*  ^ sequence  of  positive  integers,  □ 

REVESZ,  P.  (1965b).  Some  remarks  on  strongly  multiplicative  systems. 

Acta  Math.  Acad.  Sci.  Hung.  16  441-446. 

The  uniformly  bounded  sequence  of  random  variables  {X^}  is 

called  an  equinormed  strongly  multiplicative  system  (ESMS)  if  E{X^}  = 0, 

2 ■ ^1  ""Z  ''k  ’'l  ^2  \ 

E{xn  = 1 and  E{X,  X,  •••X.^=  E{x/}  E{x/}  •••F{x/}  all  1 < i,  < i.<*--<i,  , 
i i^  i2  ^1  ^2  12k 

for  k “ 1,  2,  •••,  and  r^  = 1 or  2,  j = 1,  • * k.  The  following  analogue 
of  the  Radenacher-Mensov  inequality  is  derived: 


If  {X^}  IB  an  EST’S,  then 

/ ^ 

E{  -up  (X,  -t-  X,  -^•  • •+  X.)  } =•  0(n  log  n)  , n-H*>. 

I5jin  ^ 

This  inequality  is  used  to  obtain  the  following  law  of  the  iterated  logarithm 


for  an  ESMS: 
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If  f"^}  is  an  then 


1/2 

P{lln  sup(X,  +• • '+  X )/(n  log  log  n)  ^ 6}  = 1.  H 

n-»» 


•REVESZ,  P.  (19GC) . A convergenco  theoren  of  orthogonal  sorits.  Acta.  3oi. 

I'dath.  Szeged  ^ 253-260. 

The  author  provoe  the  following  analogue  of  the  Radeinacher-IIenpov  inequality 
If  {X^}  is  a sequence  of  random  variables  for  which 
r{v^}  < K < <»  {all  1) 

(1)  and 


F{-'p^x^}  = r.{vjx..}  = = r:{x.>YY>  = 

where  i,  j,  k and  t are  distinct  and  Y.  is  a positive  constant,  then 


E{  nax  |c.X  +•  • •+  c.X,  |^}  < 8K£^(n)  cT)^  , 

l<k<n  1 J 


where  {c^}  io  an  arbitrary  sequence  of  constants  and 
l(x) 


l^(x)  = -I 


log  X if  X ^ 2 
1 if  0 < X < 2 


The  author  notes  that  the  above  leinua  is  not  the  best  possible.  In  Revesz 

4 

(1965b)  it  was  proved  that  in  the  case  = 1,  £.  (n)  can  be  replaced  by 

3 

0(1)£  (n) . The  sane  method  can  be  applied  in  this  more  general  case  to  obtain 
a stronger  inequality.  But  this  stronger  inequality  would  not  enable  the 
author  to  obtain  a stronger  result  than  the  following  result,  whose  proof 
makes  use  of  the  above  inequality. 

Let  {X^}  satisfy  (1).  Let  {c^^}  he  a sequence  of  constants  and  suppose 

00  2 2 

that  there  exists  an  integer  r such  that  I where  i (x) 

k=l 
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ia  the  r-th  iterate  of  ^(*).  Then  the  aeries  ia  almost  surely 

convergent,  fl 

REVESZ , P . (1969).  H-nixing  syster.is  I.  Acta  Math.  Acad.  Soi.  Hung.  431- 


}|  for  1 $ <•••<  , 

V 

V = 1,  2,  3,  4,  an  inequality  analogous  to  the  Rademacher-Meniov  inequality 
is  proved.  The  author  then  uses  this  inequality  to  prove  an  almost  sure 
convergence  result  for  where  is  a sequence  of  constants.  H 

REVESZ , P . (1973).  A new  law  of  the  iterated  logarlthu  for  nultlplicative 
system.  Acta.  Soi.  Math.  Szeged  3£  349-358. 

The  author  derives  the  following  maximal  inequality: 


Under  conditions  which  bound  Ie{X. 

^1 


Let  {X^}  be  a sequence  of  uniformly  hounded  multiplicative  random  variables. 

n 2 

Let  a^^,  he  a sequence  of  reals.  Let 

and  X2»  be  suitable  positive  constants.  Then 


P{  max 
iSm^n 


|S, 


K2(a" 


log  log  A)^'^^}  ^ 


exp (-2  log  log  A). 


The  key  to  the  proof  of  the  above  result  is  a judicious  partltlcn  of  I,*'",  n and 

2 1/2  2 

the  use  of  the  inequality:  P{|S^J  S y iCj^(2A  ) } i 2 exp(-y  ) for  any  y > 0, 

where  S and  A are  defined  as  above  and  |x  | S K,  all  i. 

The  laaximal  inequality  is  then  used  to  prove  that,  with  probability  1, 
only  a finite  number  of  the  events 

■ ( max  (*5(m)  - P(n^^)  >■  e'',  (*^(rij  ) lof*  lo<’  ) occur,  where 

(Uj^)  is  a seauence  of  positive  integers  and  A^(nj^)  = a^  . 


This  result  is 
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thcn  applied  in  the  proof  of  a law  of  the  Iterated  loRarltbm.  f1 

RhVLSZ,  P.  (1974).  A law  of  the  iterated  lo‘^arlthra  for  v/eakly  uultiplicative 

systens  and  its  application.  Aata  Math.  Acad.  Sai.  dung.  2^  425-433. 

The  author  defines  a generalization  of  ’multiplicative  dependencai  Let 

be’ a sequence  of  uniformly  bounded  random  variables  for  which  there 

exists  a positive  constant  K.  such  that  |e{  V (1  + b X.)}|  ^ 1C  (1  < n < n < ®) , 

^ i=n  ^ ^ ^ 

where  tb^}  is  any  sequence  of  constants  for  which  |b^j  ^ 1,  all  i.  For  a 
sequence  of  randon  variables  {X^}  satisfying  the  above  restriction,  he  obtains 
the  following  inequality: 

Let  a^,"*’,  CL^^he  a sequence  of  constants:  then 

P{  max  I - »'3(A^log  log  exp(-2  log  log  A), 

l<mSn 

where  A^  ~ \ ’ ^3'  ^4  suitable  positive  constants. 

Using  this  maximal  inequality,  he  obtains  two  laws  of  the  iterated  logarithm 
and  shows  that  these  lav/s  generalize  some  known  results  concerning  subsequences 
of  orthogonal  sequences,  sequences  of  lacunary  Ualsh  functions  and  sequences 
of  martingale  differences.  f] 

S£d,  PRAIJAB  KUiiAR  (1970).  The  Hhjek-Renyi  inequality  for  sampling  from  a finite 
population.  Sankhya  (Series  A)  ^ lai-lUd. 

For  simple  randorj  sampling  without  replacement  from  a finite  population, 
the  author  proves  a llSjek-Renyl  type  inequality  for  a broad  class  of  synuaetric 
estimators,  namely,  hoeffding's  U-statlstics . This  inequality  is  then  used 
to  provide  suitable  rates  for  the  almost  sure  convergence  of  these  statistics. 

The  Inequality  also  yields  an  inequality  co!.iparable  to  Kolmogorov's  inequality 
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for  dependent  sucmands.  The  inequality  is  as  follows: 

Let  X^,***,  represent  a random  sample  of  size  n draun  without 

replacement  from  a finite  population  of  size  N.  Define  as  the  U-statistic 

corresponding  to  a kemal  ((i(X,  X ) and  let  6,,  = E{U  } and  V = Var  {U  }. 

In  W n n n 

Then^  for  every  m ^ k < W and  every  e > 0, 

SEN,  PRAiJAii  KUMAR  (1972).  Finite  population  sampling  and  weak  convergence  to 
a Brownian  bridge.  Sankhga  (Series  A)  ^ 85-90. 

The  Hijek-R6nyi  inequality  for  U-statistics  obtained  by  Sen  (1970)  is 
used  to  show  the  convercrence  of  a sequence  of  functions  of  U-statistics  to  a 
Brownian  bridge,  for  sampling  without  replacenent.  fl 

SERFLING,  R.  J.  (1970a).  Moment  inequalities  for  the  raaxluua  cumulative  sun. 

Ann.  Math.  Statist.  £1  1227-1234. 

The  theorems  of  this  paper  obtain  bounds  on  E{M  } '^v 

a jn 

appropriate  bounds  on  E{ls  , where  S = X.  and  M = 

' a,n'  a,n  ^a+1  1 a,n 

rax(|s^  ll’"**’  l^a  n^^'  only  dependence  restrictions  are  those  implied  by 

the  assumed  bound  on  E(|s  I'')*  In  Theorem  A,  the  bounds  may  involve 
parameters  of  the  joint  distribution  of  ^a+n*  flexibility  partic- 

ularly useful  with  nen-iJentically  distributed  variables.  The  inequality  due 
to  Radenocher.-Mcr  aw  for  v = 2 an'’  orthogonal  (''^ncra1.'*ze‘’  by  thcore-'  * 

to  • vi2  and  oth®r  type''  o^  dcppn'’cnt  rao-’o’^  va’'ta‘']o".  ■"''Sorer'  ” nro^’ldee 

a hound  tot  } vhlch  Ic  a''v~'ntoticallv  ortlnrl  in  t''e  -'onse  t’*at  it  i’^ 

a,n 

of  the  '^ane  order  o^  TOfipnltude  ns  the  hpund  oc'^ume'’  for  "{  1 1'^* 

' a ,n 

Roughly  speaking,  a factor  (log22n)'’  occurrlhe  In  the  hound  elven 
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by  Theoreu  A becomes  eliminated.  As  a consequence,  the  sco{ie  of  useful 
asymptotic  applications  becomes  greatly  enlarged.  This  gain  over  Theoreu  A 
is  achieved  at  the  expense  of  requiring  that  the  bound  assumed  on  E{|S  |^} 

^ 9 T\ 

be  for  a value  of  v > 2 and  be  a function  depending  upon  F only  through  n. 

cl ) n 

The  crucial  difference  betvreen  the  proofs  of  the  two  theorems  is  that  MinkowsV^i ' s 
inequality  is  exploited  to  obtain  Theorem  A but  '..lust  be  avoided  in  Theorem  B.  H 

SERFLIiiG,  R.  J.  (1970b).  Convergence  properties  of  under  moment  restrictions, 
Ann.  Math.  Statist.  4^  1235**1243. 

A strong  law  of  large  numbers  is  obtained  for  random  variables  satisfying 

moment  restrictions  of  second  order  only.  A maximal  inequality  of  Serfling 

2 

(1970a)  is  used  in  the  proof  of  this  result  to  obtain  a bound  on  E{Y,  },  where 

k. 

Y,  = uax(|s.  r !,*■',  Is  •.  |)  and  S = X..  This  same  ? 

inequality  is  then  used  in  the  proof  of  an  almost  sure  convergence  result  for 
^00 

X^,  again  under  moment  restrictions  of  second  order  only,  A second  maximal 
inequality  of  Serf  ling-.  Cl970a)  is  then  used  in  conjunction  with  the  Borel- 
Cantelli  Lemma  to  obtain  the  desired  result.  The  result  does  not  require 
boundedness  of  the  X^^'s,  only  uniform  boundedness  of  the  vth  absolute  moments. 

The  conclusion  improves  as  v increases:  This  is  possible  because  the  maximal 

inequality  does  not  have  a factor  (log22n)'^  In  the  bound,  in  contrast  with  the 
first  mentioned  inequality.  The  maximal  inequality  is  then  used  to  obtain 
rates  of  convergence  in  the  SLLN  and  the  HL.  In  all  these  results,  the  only 
dependence  restrictions  involved  are  those  implied  by  assumed  bounds  on 

SERFLIIIG,  R.  J.  (1974).  Probability  inequalities  for  the  sum  in  sampling 


without  replacenent . Ann,  Statist.  £ 39-48. 

Maxiroal  inequlaities  are  obtained  in  sampling  without  replacement  from 
a finite  population.  These  inequalities  extend  the  Kolmogorov  and  H^jek-Renyi 
inequalities.  The  proofs  of  these  inequalities  exploit  martingale  techniques 
and  tiake  use  of  Chow's  inequality.  Applications  of  these  inequalities  to 
obtain  other  inequalities  are  presented. 

Also,  an  upper  bound  for  the  moment  generating  function  of  the  sample 
sun  is  derived  and  applied  to  obtain  exponential  probability  inequalities 
and  related  laonent  Inequalities. 

Applications  considered  include  optional  stopping  in  sequential  sampling 
and  large  deviations  of  simple  linear  rank  statistics.  H 

STEIGER,  V/.  L.  (1969).  A best  possible  Kolmogorov- type  inequality  for 
Buirtingales  and  a characteristic  property.  Ann  Math.  Statist.  ££  764-769. 

In  this  paper,  the  author  derives  some  Kolmogorov- type  inequalities. 

For  example,  let  B(n)  be  the  class  of  all  martingales  (S^}  of  n partial  sums 
Xj  , 1 S i s n,  where  {X^^}  is  a sequence  of  random  varialbes 
satisfying 

(a)  E{Xj^}  = 0 , E{X^|x^_^,---,Xj^>  > 0 

(b)  |x^|  s T , almost  surely 

and 

(c)  E{X^}  * 0 , E{X^|Xj^  1’"  " ’ ^1^  * ^ * almost  surely , all  1 $1  < 

The  author  prover- 

Let  “ nax(Sj^,*-*,  S^)  and  = E(X^)  + E{X^  |x^_^,  • • • , X^^}.  If 
{S^}  e P(n),  lilSn,  K>0  and  h(x)  > 0 is  a nondeareasing  function^  then 
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P{M  i tC^}  ^ E{h(KS  )}/h(Ktb)  , 
n n 

2 

where  \>  is  a positive  number  such  that  C s b almost  surely. 

The  following  Inequality  yields  a best  possible  upper  bound  for 

P{M  2 tC^}  for  {S,}  eB(n) 
n 1 

2 2 2 
Let  eB(n),  0 < b < C almost  surely  and  take  ^ ’■  - such  that 

2 2 

C 2 d almost  surely.  Then  for  all  t > 0 

P{M  ^ tc^}  S (d^/(d^  + txp(tb/T)  . 

n 

2 

With  b = sup(x  > 0: X C almost  surely),  the  right  hand  side  of  the 
above  is  a best  possible  upper  bound  in  B(n).  The  proof  of  the  above 
inequality  applies  a bound  for  the  moment  generating  function  for  which 
is  derived  in  the  paper.  □ 


STEIGER.  W.  L.  (1973).  A generalization  of  Dunnage's  inequality.  J.  London 
Math.  Soc.  7 1-4. 

The  following  result  is  an  extensive  generalization  of  a result  of 
Dunnage  (1970).  It  is  in  a sense  similar  to  Kolmogorov's  extension  of  Chebyshev's 
inequality. 

Let  (Xj^.F^;  i = 1,  2,  •••)  be  a martingale  difference  sequence  on  a 
probability  space  (0,  F,  P) , i.  e.,  X^,  is  F^-  measurable,  and 

E{Xi^i|Fi}  » 0 for  i = 1,  2,’*',  Let  {a^}  be  a sequence  of  real  numbers  and 
let  N be  the  set  of  natural  numbers.  For  any  meiJ,  set  ^1^1’  ” 


I'  J - \,n  = tlxj*^}  and  b^(n)  - N,n‘ 

j 5n  1 • I “t. 

The  author  provides  a concise  proof  of  the  following  rather  strong  result. 


2 

If  E(x;;}  - 1,  Ecx^^*^ 


0,  bfc  n " /or  all  k and  n and  B is  a positive 


real  number,  then  for  any  numbers  t and  d for  which  t s d i E{  la^X^^I  |Uj^}, 
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uhere  s B}  , 

P{M^  2 t}  S (b^  /B^)^  + ((dt"^)*"  . 0 

STOUT,  WILLIAM  F.  (1973).  Maxinal  inequalities  and  the  law  of  the  Iterated 
logarithm.  Ann.  Prob.  1 322-328. 

The  author  derives  two  maximal  Inequalities.  The  first  Inequality 
yields  a bound  on  the  exceedance  probability  of  the  sup  of  a nonnegative 
supermartingale.  One  of  these  Inequalities  Is  as  follows: 

Let  {Xj^}  be  an  arbitrary  sequence  of  random  variables  and  let 
®m  n * ^mi-l  n generalized  Gaussian  with  parameter  A^,  for  some  pos- 

itive number.'-  A and  all  m 2 0 and  n s 1,  1.  e..let  S satisfy  E{exp(uS  )} 

m,n  m,a 

2 

^ exp  (u  An/2),  for  all  real  u.  Then^  for  each  v > 2,  there  exists  a 
positive  constant  such  that 

E{  max  |S  |^}  S K ’ 

ISlSn 

for  all  m i 0 and  n 2:  1. 

The  author  then  uses  the  maximal  inequality  approach  of  Serf ling  (1970a) 
to  derive  an  upper  half  law  of  the  Iterated  logarithm  for  generalized 
Gaussian  random  variables.  An  upper  half  law  of  the  iterated  logarithm  for 
supermartingales  Is  also  derived.  0 

SZYNAL.  DOMINK  (1973).  An  extension  of  the  K4jek-R6nyl  Inequality  for  one 
maximum  of  partial  sums.  Ann.  Statist,  740-744. 

This  paper  gives  an  extension  of  the  HAJek-R^nyi  Inequality  and  of  the 
Kolmo3orov  inequality  free  of  nouent  conditions  and  of  the  assumption  of 
Independence . 
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If  {X^}  is  any  sequence  of  random  variables,  Xj^  and  {Cj^}  is  a non- 

increasing sequence  of  positive  constants,  then,  for  any  positive  integers 
m,'.n  with  m < n and  arbitrary  e > 0,  we  have 

P{  taax  ^ 3e}  < 2(J“  |xj  V((b^e)’'  + |xj’’)}  + 

m<k^n 

+ 1^1  E^^®{lxjV((b^e)’'  + IXJ""})®  , 
where  s = li/0<rSl  and  s = r i/  r > 1 and 

This  theorem  is  a generalization  of  results  of  Kounias  and  Weng  (1969).  Tfie 
author  presents  two  examples  which  elucidate  the  relation  between  his 
theorems  and  those  of  Kounias  and  Weng. 

The  author  then  applies  these  inequalities  in  the  proofs  of  almost  sure 
convergence  and  convergence  in  probability  results  for  tS^}.  0 

TEICHER,  HENRY  (1967) . A dominated  ergodic  type  theorem.  Z.  Wahrscheinlich- 
keitstheorie  8_  113-116. 

Teicher  gives  conditions  under  which  E{sup  c |7?X. 1*^}  < ®.  He  deals 

n^l  ^"*1 

with  the  case  r ^ 2 and  {X^}  a sequence  of  iid  random  variables.  He  then 
gives  moment  conditions  on  {X^^}  and  places  bounds  on  in  order  to  achieve 

finitenesa^  In  proving  the  main  result,  the  author  derives  an  inequality 
similar  to  the  Chow  (1960)  inequality: 

2 

If  {U^,  is  a martingale  with  is  a positive 

decreasing  sequence  of  constants,  then 

P{  max  c |U  I S X}  < cj  E{U.  - U,  , , for  X > 0 . D 

l<j<n 
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VOLKONSKII.  V.  A.  (1957).  A mult 1-demens ional  limit  theorem  for  homogeneous 
Markov  chains  with  a countable  number  of  states.  Th.  Prob.  Apptia.  2^  221-244. 
The  author  proves  the  following  theorem: 

Let  Xj^,  X2»'**  be  independent,  identically  distributed  random  variables 

and  let  b ^ I?  X.  converge  in  distribution.  Then,  as  e 0,  b ^ max 

" k<£.n 

converges  in  probability  to  0. 

The  proof  of  this  result  makes  use  of  the  Kolmogorov  Inequality  and  the  L4vy 
Inequality.  0 

WICHURA,  MICHAEL  (1969).  Inequalities  with  applications  to  the  weak  conver- 
gence of  random  processes  with  multidimensional  time  points.  Arm.  Math. 

Statist.  ^ 681-687. 

Let  D.  . (iSj  Sn,lip<q)be  independent  random  variables 

j ••■,1  ' -Jp  p’  y 'i' 

* ^ 

with  zero  means  and  finite  variances.  Set 

M = max{|s  |:lSk  5n,lSpSq}  and  = E{S^  ...  ). 

P P "r  *“q 

It  is  shown  that  E{M^}  S 4%^  and  inequalities  for  P{M  > 2'^a}  are  derived, 
for  instance, 

P{M  > 2‘*a>  s (1  - o^/a^)"**  P{|s  „ | > a}  , if  < a^  . 

"l’’*  ’ q 

The  proof  of  Wichura's  main  theorem  is  based  on  a submartingale  inequality 
of  Doob.  Special  cases  of  this  theorem  yield  Kolmogorov's  inequality,  a 
limited  H^Jek-R^nyl  inequality  and  several  other  well  known  maximal  inequalities. 
The  theorem  is  used  to  establish  the  weak  convergence  of  certain  random 
functions  defined  in  terms  of  the  partial  sums,  S.  ....  H 

1*  ♦ q • 
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